max rank | avg. rank | sentence |
---|---|---|
278 | 105.0000 | I don’t know him and have never done any business with him. |
328 | 106.0000 | “If they still want me they should show it. |
363 | 122.0000 | “The problem is with the media as well. |
364 | 128.1111 | “I think it’s something that we have been saying. |
426 | 125.2500 | “We were looking after her as a family. |
435 | 151.8889 | We want to make this country great again. |
455 | 138.5000 | And the question is how will an election do this? |
481 | 219.2857 | “Our position was always put people first. |
495 | 116.8889 | We also can bring money into the country. |
517 | 197.8750 | These are parties that I am taking about. |
527 | 145.1429 | “I understand why people are saying that. |
541 | 263.4286 | They have let Zimbabwean football down too. |
554 | 188.3333 | Zimbabwe has the human resources to do better. |
556 | 155.6154 | It needs a lot of time to form one, it’s a process. |
557 | 368.4286 | These include both human and financial resources. |
577 | 165.6667 | I have been training with them for the past two months. |
577 | 222.0000 | That was when I started a training course from God. |
579 | 202.2000 | “It’s in the process, we are actually working towards that. |
590 | 188.6364 | “The people who took us to court had actually been paid. |
613 | 168.6250 | We have no opposition currently in this country. |
616 | 126.2500 | As always more can be said but we stop here for now. |
625 | 202.7500 | If any new council say, they win elections. |
644 | 132.5000 | This story says a lot about what we still need to do as a country. |
648 | 151.4545 | Why is it that they are not doing anything about it? |
667 | 213.9286 | No other team has won it more than once in the same period. |
668 | 281.0000 | “I have never done anything wrong to anyone. |
676 | 108.7368 | There has to be a end to the Mugabe government and this is the stand I am taking now. |
683 | 189.9167 | “They are a good side and they have quality especially going forward. |
698 | 167.6154 | You will have to take her to court to challenge her leadership. |
736 | 286.0000 | “These days you just have to try everything. |
The maximum word rank of a sentence is by definition the rank of the rarest word in the sentence. If it is low, all words in the sentence are of high frequency. For this reason the table of the sentences with least maximum word number might be of interest. In the table, we see the corresponding sentences with a minimum length of 40 characters.
The over all distribution of the maximum rank in all sentences of the corpus is shown in a diagram with log-scaled x-axis.
The sentences in the table described above are of interest because they are usually easy to understand. The distribution may give insights into the corpus and may give parameters for language comparison.
While the distribution might be deduced from a small corpus, the sentences in the table are rare and a large corpus will give more impressive results.
Table data:
select max(w_id)-100 as m, avg(w_id)-100 as a, s.sentence from sentences s, inv_w i where s.s_id=i.s_id and length(sentence)>40 and i.w_id>100 group by s.s_id order by m limit 30;
Distribution data;
select m, count(*) from (select 100* round((max(w_id)-100)/100) as m from sentences s, inv_w i where s.s_id=i.s_id and i.w_id>100 group by s.s_id) aa group by m;
Explain the distribution, especially the increase in its right part.
4.5.2.2 Average word rank in sentence
4.5.2.3 Sentences consisting of many low frequency words I
4.5.2.4 Sentences consisting of many low frequency words II
4.5.2.5 Sentences consisting of short words only I
4.5.2.6 Sentences consisting of short words only II
4.5.2.7 Sentences consisting of long words only I
4.5.2.8 Sentences consisting of long words only II